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1. Introduction 

The QCD partition function on the lattice is usually written as 

Z = j DUDyDye~ s = j DU e~ s ™ detM, (1.1) 

where U denote the gauge links, Sym is the Yang-Mills action, and in the final expression the 
quark fields have been integrated out to yield the fermion determinant. At nonzero quark chemical 
potential /r, this determinant is complex, 

[detAf(ju)]* = detAf(-/i*), (1.2) 

unless the chemical potential is taken as purely imaginary. With a complex Boltzmann weight (for 
real ju), numerical lattice QCD simulations relying on importance sampling are not straightforward 
and hence the QCD phase diagram has not yet been determined from first principles. This problem 
is usually referred to as the sign problem and may refer more generally to any problem in which 
a complex Boltzmann weight is encountered or in which important minus signs appear due to the 
Grassmann nature of the fermionic fields. 

As is well-known [1], the problem of a complex weight is hard and cannot be ignored. For 
instance, simply taking the absolute value of the determinant and incorporating the phase factor 
later (reweighting) will typically destroy the correct physics, especially in the thermodynamic limit 
(overlap problem). In this contribution I will present a selection of recent approaches which aim to 
tackle the sign problem in QCD and related theories. Some complementary reviews touching on 
related developments can be found in Refs. [2-8] and I will attempt to avoid too much repetition. 
In the next section, we start with the notion that the overlap problem might be milder if the order 
of integration is changed. Section [| is devoted to the density of states, in which the integration is 
earned out in two steps. Finally, in section fl] the complex nature of the weight is taken seriously 
and the configuration space is extended into the complex plane, using either complex Langevin 
dynamics or integration along Lefschetz thimbles. 

2. Change integration order 

In the standard formulation of lattice QCD, the sign problem arises due to the complex fermion 
determinant at nonzero chemical potential, obtained by performing the Grassmann integrals over 
the quark fields. Hence it makes sense to not integrate out the fermions immediately but instead 
perform the integral over the gauge links first. This is of course easier said than done, since the 
gauge sector is an interacting theory by itself. The first step is to consider the strong-coupling 
limit, with the gauge coupling /3 = 2 N c /g 2 = 0. In this case the link integrals factorise to one-link 
integrals, which can be done analytically. The resulting remaining partition function is known as 
the Monomer-Dimer-Polymer (MDP) system [9] and describes worldlines of mesons and baryons. 
In recent years this system has been studied in more detail [10,11], which has been possible mostly 
due to the use of new worm-type algorithms. 

The obvious question is how to go beyond the strong-coupling limit. Here recent progress 
has been made [12] by including the first corrections, namely by expanding the Yang-Mills 
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Figure 1: Phase diagram in the aT — ajj. plane in the strong-coupling limit (/3 = 0) and by including //(Ji ) 
corrections, in the chiral limit. From Ref. [12]. 




Figure 2: Illustration of how auxiliary fields Q and R reduce a four-link plaquette to decoupled single links 
in the presence of auxiliary fields. From Ref. [15]. 


weight as 

g-s Y M = 1 -f [plaquettes] + ... (2.1) 

The /3) corrections can be included either by reweighting from the /J = 0 ensemble or by again 
using worm-type algorithms. Details at this meeting were presented by Unger. 

An example of the phase diagram is shown in Fig. [I], in the T — fit plane (in lattice units), 
for massless quarks. For small chemical potential, the transition is second order, while for larger 
chemical potential it is first order. The second and first-order line meet at a tricritical point. It can 
be seen that the critical temperature aT c decreases with increasing /3, whereas the tricritical point 
only depends weakly on /3. On the other hand, at nonzero /3, the critical endpoint of the nuclear 
transition, studied via the baryon density, shifts to smaller temperature. Clearly the next step is to 
include A’(/3 2 ) corrections, in order to see whether the expansion converges in any practical sense. 
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Another approach to go beyond the strong-coupling limit is to include the plaquettes by inte¬ 
grating them in steps. Each plaquette consists of four links and the idea here is to decouple those 
by introducing sets of auxiliary fields, as in a Hubbard-Stratonovich transformation. This is illus¬ 
trated in Fig. |2[ in the figure on the left the auxiliary Q fields breaks down the plaquette into two 
two-link components, while on the right the fields R reduce those to decoupled single links. This 
setup was originally discussed 30 years ago [13] and has been recently taken up by Vairinhos [14] 
and de Forcrand and Vairinhos [15]. While the link integrals can now be done, the integrals over 
the auxiliary fields of course remain. It is clear that this approach leads to a completely alternative 
representation of the QCD partition function and hence there is a hope that the sign problem may 
appear in a milder form. For an alternative formulation, see Ref. [16]. Recent developments were 
presented at this meeting by Vairinhos. 


3. Density of states 


The basic idea in the approach known as density of states is to do the path integral. 


Z = 



(3.1) 


in two steps, using contrained simulations. For instance, if we consider the density of states for an 
operator x, defined as 

p(x) = j DUw(U)8[x-x(U)\, (3.2) 

observables depending on x can be reconstructed via 


(0(x)) 


f dxp(x)0(x) 
f dxp(x ) 


(3.3) 


Variations on this idea have been around for a long time, and are known as the histogram method, 
factorisation, Wang-Fandau, etc [5,17-20]. 

The main issues in this approach are quite obvious from the expressions above: 


1. the contrained integral should have a positive weight, so that it can be determined unambigu¬ 
ously; 

2. the weight p (x) should be computable to very high relative precision. 

Let us now consider theories with a complex weight, written as 

w(U) = \w(U)\e w . (3.4) 


As observable we consider the density n and for simplicity we assume that the phase factor depends 
only on the density, i.e. 0 = Q(n). The positive density of states is then 

p(x) = j DU \w(U)\8[x — n(U)}, (3.5) 

and observables are given by 

(0(x)> = ^j dxp(x)e w ^O(x), Z = j dxp(x)e id( - x) . (3.6) 
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Figure 3: Density of states in the Z(3) spin model at nonzero chemical potential, as a function of x = 
N | — N , the net density, on a normal scale (left) and on a logarithmic scale (right). Also shown is the 
histogram obtained with ordinary sampling. Infrequent events, say with |x| > 1000, are not covered by the 
histogram but can be sampled with the density of states. From Ref. [22]. 


A recent promising reincarnation of the density of states has been introduced by Langfeld, Lu- 
cini and Rago, and dubbed local linear relaxation or LLR [21], There are various improvements 
compared to previous work: 

1. precise sampling of p(x) over many orders of magnitude; 

2. forced sampling in bins of width Ax around x with relative fluctuations of < 1% and no loss 
of efficiency; 

3. precise integration over the oscillating function p(x)e lf>ix h 

An application to finite density was recently given in the Z(3) spin model with a nonzero chemical 
potential in Refs. [22-24]. The result for the density of states for x = N + — N-, the net particle 
density, is shown in Fig. |3[ on a normal scale (left) and on a logarithmic scale (right). Also shown 
is the histogram, constructed by simply recording values of the density obtained during a standard 
simulation, ffere it is clear that rare events, say with \x\ > 1000, occur so infrequently that they are 
not covered by the standard histogram. On the other hand, the density of states extends over more 
than 60 orders of magnitude, with |x| up to 5500, since sampling in bins around a given value of 
x is enforced. Such precision and extent is required to perform the integral over the phase factor 
e l0<x> and ensure all cancelations are correctly accounted for. 

In the Z(3) model it is possible to compare the results with an alternative dual formulation, 
which is manifestly free of the sign problem [25]. A comparison of the two approaches for the 
observable 

Ku)M(A+-W_>| (3.7) 
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Figure 4: Comparison between the results obtained with the density of states (LLR) and in the dual formu¬ 
lation in the Z(3) spin model at nonzero chemical potential. From Ref. [24]. 


is shown in Fig. |], as a function of p. It is seen that the results from the dual formulation and the 
density of states agree, although there are still open questions about what happens at large /i and 
potentially at the transition [24]. 

In any case, it is clear that the LLR implementation of the density of states is a consider¬ 
able improvement on previous histogram methods. Moreover, the extension to gauge theories is 
currently in progress. 

4. Complexification 

With a complex weight, it makes sense to look for dominant configurations in the path integral 
not on the original real manifold but in the complexified configuration space. Indeed, the idea 
behind complex Langevin dynamics [26, 27] is that there exists a real and positive distribution 
P(x,y) (here for one real degree of freedom x), such that 

jdxp(x)0(x) = I dxdyP(x,y)0(x + iy). (4.1) 

This distribution is effectively sampled by the stochastic process in x and y. Equilibrium is reached 
as in Brownian motion. 

For holomorphic actions, it has been established that the method is correct, provided that 
certain criteria for correctness are verified a posteriori [28, 29]. In nonabelian gauge theories, 
gauge cooling is essential to establish this [30]. For nreromorphic drifts, i.e. with poles, problems 
may arise, but not necessarily so [31]. The first results for full QCD were obtained by Sexty [32]. 
Recent results for heavy dense QCD are summarised in Ref. [33]. Some ideas based on experience 
with random matrix theory can be found in Refs. [34,35]. 
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Figure 5: Dependence of the quark density (in lattice units) on the order of the truncation in the spatial 
hopping parameter (k s ) expansion, for id = 0.7 and 0.8, on a 8 4 lattice. The lines show the result for full 
QCD. From Ref. [36]. 


A recent development in QCD is the implementation of the hopping parameter expansion to 
very high order, e.g. f/(K 50 ), and a comparison with full QCD, i.e. without an expansion [36]. An 
illustrative result is shown in Fig. |5[ where the density is shown for two values of the chemical po¬ 
tential as a function of the order of the truncation in the hopping expansion. The hopping expansion 
used is an expansion in the spatial hopping parameter only (k s expansion); the temporal hopping 
term is dealt with analytically. The truncated theory still suffers from a sign problem, which is 
handled with complex Langevin dynamics. Also shown are the results in full QCD, obtained with 
complex Langevin dynamics as well. We observe therefore both a convergence of the hopping 
parameter expansion and an agreement with the full result, providing justification for both. More 
details were presented at this meeting by Sexty. 

Another way to explore the complexified configuration space, possibly with more analytical 
control, is by integrating along so-called Lefschetz thimbles, i.e. using essentially a generalised 
saddle point expansion. In this setup one integrates numerically along lines of steepest descent, for 
which the imaginary part of the action in the weight is constant. Hence the sign problem is kept 
under control, at least to some extent (there is still a remaining residual sign problem, due to the 
curvature of the thimbles) [37]. This method has now been implemented in various models and 
recent work focussed on an accurate computation of the residual phase [38,39]. The most recent 
result is for chiral random matrix theory at nonzero chemical potential [40]. 

Since both complex Langevin dynamics and the Lefschetz thimbles explore the complex field 
space, it makes sense to compare and contrast the two approaches. This has been done recently in 
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Figure 6: Comparison between the distribution sampled in complex Langevin dynamics (brown sausage 
shape) and the stable/unstable thimbles (full/dashed) passing through the fixed points (blue circles) in the 
SU(2) one-link model with complex coupling j3 = (1 + is/ 3)/2. The red squares indicate where the reduced 
Haar measure has a zero and the thimbles end. From Ref. [42]. 


Refs. [41,42], in the case of simple integrals of the form 

Z = J dxe~ s ( x \ S(x) =—x 2 +—x 4 + hx, 


(4.2) 


with a and/or h complex, and for simple one-link U(l) and SU(2) models in the presence of a 
determinant and/or a complex coupling, for instance 


Z = 


/ dU exp 

dSU(2) 



(4.3) 


with complex /3 and a gauge symmetry, U —>• Q.UQ. ', where U. <2 <G SU(2). 

For illustration we show in Fig. || a result for the SU(2) model (fP|), with /3 = (l + iV3)/2. 
The full (dashed) lines indicate the stable (unstable) thimbles, passing through the stationary points 
(blue dots). The red squares indicate a zero in the reduced Haar measure; here the thimbles end. 
Integrating along the stable blue thimble yields the correct result. The distribution effectively 
sampled in the Langevin evolution is indicated with the shaded sausage-shaped region. Hence it 
can be observed that the thimble and the Langevin distribution cover a similar region in the complex 
configuration space around the attractive fixed point - although the thimble is one-dimensional 
and the latter two-dimensional. This observation appears to be generic: Langevin and thimble 
dynamics explore similar parts of the configuration space, although they differ in detail, e.g. due to 
the presence of repulsive fixed points in Langevin dynamics [42]. 
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5. Outlook 

The sign problem is a fundamental obstacle in making progress towards the determination 
of the QCD phase diagram. Various ideas are currently being pursued and new algorithms are 
typically implemented in the simpler models first. For full QCD, complex Langevin dynamics 
appears to be the most promising, but caution and care have to be considered at all times. 
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